Incremental Computation of Taylor Series and System Jacobian in DAE solving using Automatic Differentiation INCREMENTAL COMPUTATION OF TAYLOR SERIES AND SYSTEM JACOBIAN IN DAE SOLVING USING AUTOMATIC DIFFERENTIATION

We propose two efficient automatic differentiation (AD) schemes to compute incrementally Taylor series and System Jacobian for solving differential-algebraic equations (DAEs) by Taylor series. Our schemes are based on topological ordering of a DAE’s computational graph and then partitioning the topologically sorted nodes using structural information obtained from the DAE. Solving a DAE by Taylor series is carried out in stages. From one stage to another, partitions of the computational graph are incrementally activated so that we can reuse Taylor coefficients and gradients computed in previous stages. As a result, the computational complexity of evaluating a System Jacobian is independent of the number of stages. We also develop a common subexpression elimination (CSE) method to build a compact computational graph through operator overloading. The CSE method is of linear time complexity, which makes it suitable as a preprocessing step for general operator overloaded computing. By applying CSE, all successive overloaded computation can save time and memory. Furthermore, the computational graph of a DAE reveals its internal sparsity structure. Based on it, we devise an algorithm to propagate gradients in the forward mode of AD using compressed vectors. This algorithm can save both time and memory iv when computing the System Jacobian for sparse DAEs. We have integrated our approaches into the Daets solver. Computational results show multiple-fold speedups against two popular AD tools, FADBAD++ and ADOL-C, when solving various sparse and dense DAEs.